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Abstract — Linear receivers are considered as an attractive low- 
complexity alternative to optimal processing for multi-antenna 
MIMO communications. In this paper we characterize the per- 
formance of MMSE MIMO receivers in the limit of large antenna 
numbers in the presence of channel correlations. Using the replica 
method, we generalize our results obtained in (11 to Kronecker- 
product correlated channels and calculate the asymptotic mean 
and variance of the mutual information of a MIMO system of 
parallel MMSE subchannels. The replica method allows us to use 
the ties between the optimal receiver mutual information and the 
MMSE SIR of Gaussian inputs to calculate the joint moments 
of the SIRs of the MMSE subchannels. Using the methodology 
discussed in Q] it can be shown that the mutual information 
converges in distribution to a Gaussian random variable. Our 
results agree very well with simulations even with a moderate 
number of antennas. 

I. Introduction 

The next generation of wireless communication systems is 
expected to capitalize on the large gains in spectral efficiency 
and reUabiUty promised by MIMO multi-antenna communica- 
tions in and include MIMO technology as a fundamental 
component of their physical layer |4|. To keep the complexity 
within limits, the standardization and the current commercial 
implementation of these systems has focused on schemes, 
based on linear spatial equalization. 

Consider the following system design issue; for a given 
target spectral efficiency, block-error rate, operating SNR, 
and receiver computational complexity (including power con- 
sumption, VLSI chip area etc.) how many antennas do we 
need at the transmitter and receiver? Consider the outage 
probability curves of Fig. [T] and suppose that we wish to 
achieve a rate of i? = 3 bpcu with block-error rate of lO"'^ 
at SNR not larger than 15 dB. With M ^ N ^ 2 antennas 
this target performance is achieved by an optimal receiver, 
but is not achieved by the MMSE receiver. However, with 
M = 2, N = 4 OT M = N ~ 3 the target performance is 
achieved also by the MMSE receiver. It turns out that, in some 
cases, adding antennas may be more convenient than insisting 
on high-complexity receiver processing. 

It is therefore interesting to analyze the outage probability 
of a linear receiver with coding across the antennas in the 
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Fig. 1. Comparing the outage probability of optiinal and MMSE receivers, 
R = 3 bpcu. 



regime of fixed SNR p and rate R. This analysis is difficult 
due to the fact that, for finite M, N, the joint distribution of the 
channel SINRs {7fc} in ^ escapes a closed-form expression. 
This problem can be overcome by considering the system in 
the limit of a large number of antennas. 

In this paper, we generalize the approach developed in [T] to 
handle channels with correlations across the antennas. We will 
sketch the proof of the distribution of the mutual information 
approaching a gaussian distribution in the large antenna limit 
and we will calculate, applying the random matrix theory 
and the replica approach to characterize the limiting joint 
Gaussian distribution of the SINRs for the case of correlated 
channels and obtain the statistics of the mutual information 
of linear MMSE receivers. The analysis provides accurate 
results even for a moderate number of antennas and allows 
to quantify how the performance loss in terms of diversity 
suffered by linear receivers may be recovered by increasing the 
number of antennas. This analysis prompts to the conclusion 
that in order to achieve a desired target spectral efficiency 
and block-error rate, at given SNR and receiver complexity, 
increasing the number of antennas and using simple linear 
receiver processing may be, in fact, a good design option. 



It should be pointed out that asymptotic Gaussianity has 
been shown ||7|, lH for the MIMO channel mutual information 
given by the "log-det" formula, whose cumulative distribution 
function (cdf) yields the block-error rate achievable by optimal 
coding and decoding. At the same time the asymptotic Gaus- 
sianity of the SINR of a single MMSE receiver channel was 
derived in ||9l, ifTOl . without looking at the joint Gaussianity 
of all SINRs for all these channels. The joint Gaussianity of 
SINRs is crucial in the analysis of the statistics of the total 
mutual information. 

II. System model 

The output of the underlying frequency flat slowly-varying 
MIMO channel is given by 



t = 1,...,T, 



(1) 



where G C denotes the channel input vector at channel 
use t, Wf ~ CJV{0, NqI) is the additive spatially and tempo- 
rally white Gaussian noise and H e C^^^^ is the channel 
matrix. In this work we make the assumption that the entries 
of H are zero-mean Gaussian with separable correlations, i.e. 



(2) 



where R and T are the N x N and M x M correlation 
matrices at the receiver and transmitter, respectively. Also 
H is assumed constant over the duration T of a codeword 
(quasi-static Rayleigh i.i.d. fading |2]). The input is subject 
to the total power constraint jjj^^ [||X|||,] < Eg, where 
X = [xi , . . . , xt] denotes a space-time codeword, uniformly 
distributed over the space-time codebook X, and j| • ||f denotes 
the Frobenius norm. Furthermore, we define the transmit SNR 
p as the total transmit energy per time-slot over the noise 
power spectral density, i.e., p = MEs/Nq. We assume no 
Channel State Information (CSI) at the transmitter and without 
loss of generality we also assume perfect CSI at the receiver 
In addition, we make the convenient assumption of Gaussian 
inputs and large block length T. 

We consider a MMSE memoryless receiver with signal to 
interference and noise ratio at the fc-th receiver output given 
by B 



Ik 



M 



I+^HfcH 



M 



1 



(I+^HHH) 
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where denotes the N x (M — 1) matrix obtained by 
removing the fc* column, h^, from H. Further assuming 
ideal interleaving and coding across antennas, the performance 
metric characterizing such a system is the outage probability 
Pout{R) ~ Prob{lN < R) where the mutual information 1^ 
is 

M 

/at ^^log(l+7fc) (4) 

k=l 



III. Methodology 

In the next subsection we will sketch the methodology used 
to show the asymptotic Gaussianity of the mutual information. 
Subsequently, in Section UlI-BI we will calculate the first and 
second cumulant moments of the MMSE SINR for correlated 
channels, which suffice to characterize the mutual information 
limiting distribution. 

A. Asymptotic Gaussianity of the mutual information 

In order to prove the asymptotic Gaussianity of the mutual 
information /jv, we will need to analyze its cumulant moments 
Cn for large N, given by the expansion of the logarithm of its 
characteristic function $Af(w) = E 



log$jv(w) 



E 

n=l 



(5) 



For example, the first two cumulant moments of X are the 
mean Ci = E[X] and the variance C2 = Var[X] of /^v. When 
all cumulant moments C„ for n> 2 vanish in the limit N — > 
00 it can be shown|JJ that the distribution of 1^ approaches 
a Gaussian. 

In Section IIII-BI we will show that in the limit of large 
and M = (3N with /3 < 1, 



C2 = 



2 



ro(l) 
0(1) 



(6) 
(7) 



where mi = A/cio + Cn, and where ciq, Ch and are 
constants independent of N for which we give general analytic 
expressions and for i.i.d. channels closed form expressions. In 
HI, Q we show that all higher-order cumulants of the mutual 
information asymptotically vanish for large A^. 

B. Joint cumulant moments of the SINRs of order 1 and 2 

Our goal is to calculate the mean and variance of In- 
Since In consists of a sum of mutual informations of the 
virtual channels (see (HI), the building blocks of the cumulant 
moments of In are the joint cumulant moments of the SINRs 
{7fe}. It can be shownll] that to calculate the mean E[/Ar] to 
order 0(1) we need the mean of to order 1/N and the 
leading term in the variance of 7^.. In addition, the variance of 
In will require the cumulant joint cross-correlations Ec[7fc; 7;. 

With the above in mind, we will apply the methodology 
developed for the calculation of the moments of the "logdet" 
formula (i.e. the optimal receiver mutual information of MIMO 
correlated Gaussian channels to the analysis of the joint 
moments of the MMSE SIR's, 7fc. The link between the two 
is given by the simple relation lfT2l 



d 

— Tr log 

ax 



Tr 



M 



HJfc(0)H" f-HJ'fe(0)H^ 



M 



(8) 
(9) 



Jfc(a^) = 1+ {x—l)8k, where 8^ is a matrix a single non-zero 
element {Sk)ij = SikSjk, the RHS of the above equation is 



exactly 7^. For simplicity we will suppress the x-dependence 
in 3k{x) when not necessary. Thus 



7fe 



Tr 

d_ 

dx 



I + -^HJ,(0)H^^] ^H^feH"|>(10) 



In {3 k 



\x=0 



where we define the /c'th channel mutual information by 
A{3k{x)) ^Ak^Tr {log [l + ^HJfe(x)H"] }. The above 
relation allows us to evaluate the joint cumulant moments of 
7fc through the cumulant moments of Ak, e.g. 



(11) 



d^E, [A{Jkixk))A{3i{xi))] 



dxkdxi 



(12) 



The mean of the mutual information in (fTTT i can be evaluated 
in many different ways in the asymptotic N limit. We will 
quote the result below directly Q. 



E[Ak] = Tr log (l + ^tkik 



MtkVk (13) 



Tr log (1 + VprfcR) + 0(l/iV) 



tk 

rk 
Tk 



-Tr 



M 

^Tr 
M 

TJkix 



I + y/prkR 



(14) 

(15) 
(16) 



To evaluate the mean SINR E[7a;] we take the derivative with 
respect to x of the above quantity and evaluating (fTTl i we find 
that the mean SINR £[7^] is equal to 



7fc 



Tr 



tk^pT^ 



1-1 

Vk 



(17) 



_I + VpifcTJfc(0) 
where rjk is fc-diagonal component of the matrix 77-transform 



{i + tkT^y 



kk 



(18) 



The relation with the r]k transform Iil4j can be readily seen by 
comparing ( fTSl l with Q. The quantity tk in the above result is 
evaluated by solving ( fT4] i. ( fTSl l with Jfc(O). The leading order 
result in N can be obtained by making the approximation 
Jfc = I in ( fTsT l. We call these solutions to, rp. To get the 
correction to 7^ we need to evaluate the correction St = t — to 
due to the fact that Ja:(0) =I — Sk- Solving a pair of coupled 
linear equations for St and the corresponding correction 6r 
and inserting the result in ( fTTI i we get 



S-fk 



V'k' 



M, 



r2 



(19) 



where 



V'k 



drjk 
dtk 



Mr. 



M,2 = 



1 



-.Tr 



^Tr 
M 



Xl + tkT^) _ 
l + tkT^) 



kk 



I + rfeR^P 



(20) 
(21) 
(22) 



To evaluate the second joint moments of the mutual informa- 
tion as in ( fT2] ). we can take derivatives of the joint moment 
generating function, defined by 



gkiiy^.v) = log] 



'liAk(3k)-vAi{3i) 



evaluated at // = = 0. Thus, 

d"^ d^gki{n,v) 



Ec[lk\ll\ 



dxkdxi dfidiy 



(23) 



(24) 



Xk=xi=0;fJ.=v=0 



We will leave the details for the appendix. Here we will just 
quote the result: 



E,[Ak;A,] = -\og[l-Mt,fyMr,,r,] 



M, 



P 



JfcT 



rk,ri 



M 



Tr 



tkJkT^I + tiJiT^ 
R R 



(25) 



(26) 



(27) 



_I + Rrky/pI + Rri^_ 

where tk ,ti,rk,ri are solutions to the equations (fT4l i. ( fTSl ) for 
Jfc and J; respectively. Taking now derivatives with respect 
to Xk, xi and setting these to zero we arrive at the following 
robust expression for the joint moments of 7^, jj 



dHog[l^Mt,^t,Mr,^r,] 



(28) 



where the Xi derivatives should also be applied on ti, ri, whose 
X dependence can be traced to ( fT4b . ( fTSl l. When i = j, the 
matrices Si = Sj, but the derivatives over Xi and Xj should 
be taken separately. The matrix S is the correlation matrix 
of the sir's 7fe. In the limit of uncorrected channels H, i.e. 
R = I and T = I, all diagonal and off-diagonal elements 
of S are equal with each other The result can be written in 
a very simple form in terms of the mean 7^, E[7fc] = g = 
tk^P = (P(l v/(p(l-/3)-/3)2+4p/3)/(2/3) m 

as follows: 



1 



09' 



Ml- 13 



(1+9)" 



M 



+ 



M2(l + 5)^(l-/3(^)' 



(29) 



(30) 



M2 



(1 + 5)^ (1 



Vod 

M2 



As we see, the diagonal correlations of 7^ are 0{\/M), while 
the off-diagonal ones are 0(l/il/^). This scaling holds also 
for the general case ( l28T l. Despite the different appearance, the 
above result is identical to the one presented in |[T|. 

C. Gaussian approximation and outage probability 

We will now use the previous results to give an explicit 
Gaussian approximation for the outage probability of the 
MMSE receiver with coding across the antennas in the regime 
of fixed SNR and large number of antennas. 

We start with the mean E[/7v]. Taking into account the 
fact that the SIR's 7^ are asymptotically jointly gaussian with 



correlations given by 
1/M as follows 



we may expand (01 in powers of 



M 

E 

fe=i 



E[log(l + 7fe)] 



(31) 



= ^log(l + 7fe) + ^('57fc + Sfcfc) 
fe fe 

where 7^, 5^k and Y^kk are given by (fTTI i. ( fT9l ) and 
respectively. The first sum above is equal to A/cio and gives 
the leading order term of the mean of the mutual information 
Im- The second sum, which is 0(1), since both summands are 
0{1/M), is cii appearing in mi in (|6]l. While, the coefficient 
cio is known, the evaluation of the correction cn is novel, to 
the best of our knowledge. 

We now turn to the variance of the mutual information. 
Generalizing the approach used in O] we can show that the 
variance can be written as 



fe 



^fefe 



1 + 7fc 

Vod . 



+E 



^kl 



(l + 7fc)(l+7/) 



{1+9? 



o{l) 



(32) 



(33) 



The second line is valid when the channel has no correlations, 
with Vd, Vod given by ( |29] |. (|30] |, respectively. The evaluation 
of C2 = cr is novel, to the best of our knowledge. 

Under this Gaussian approximation, we can easily evaluate 
the outage probability for fixed SNR, /3 and number of 
antennas M as follows: 



Pout(i?)~g 



R-Ci 



(34) 



where Q{x) = 



2tt 



* ^^dt is the Gaussian tail function. 



D. Simulations and comparisons 

In this section we validate the asymptotic analysis by com- 
paring the Gaussian approximation to the outage probability 
with finite-dimensional Monte Carlo simulation in the case of 
uncorrected channels. For the sake of comparison, we also 
consider the outage probability of the optimal receiver, given 
by the log-det cdf < R), where 7^^* = logdet(I + 

-^HH'^). Using the results for the mean and the variance, 
we plot the CDF of the (Gaussian) mutual information for 
the MMSE and optimal receiver in Figs. I2I3I Both analytical 



and empirical results are plotted, for a wide range of Af , N 
and SNRs. We notice that the analytical and empirical results 
match closely, for even moderate number of antennas and not 
too large SNRs. 
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Fig. 2. CDF of the mutual information (MI) for the MMSE and optimal 
receivers, for M = 2,3, 13 = 0.5 and p = 3, 30 dB. The solid blue line is 
the analytical result for the MMSE, the dot-dash blue is MMSE empirical, 
the dashed black is Optimal receiver analytical and the dotted black is the 
optimal receiver empirical. 



IV. Conclusions 

Novel wireless communication systems are targeting very 
large spectral efficiencies and will operate at high SNR thanks 
to hot-spots and pico-cell arrangements. System design is tar- 
geting even higher data rates, up to IGb/s, in 40 MHz system 
bandwidth. For such systems, the use of low-complexity linear 
receivers in a separated detection and decoding architecture 
as those examined in this paper may be mandatory because of 
complexity and power consumption. 

In this paper we investigated the asymptotic performance 
of the linear MMSE receiver with coding across the antennas 
in the regime of fixed SNR and large (but finite) number of 
antennas for a general Kronecker-correlated Gaussian chan- 
nel. We showed that the corresponding mutual information 
has statistical fluctuations that converge in distribution to a 
Gaussian random variable, and we computed its mean and 
variance analytically. This paper used a different method in 
calculating the moments of the mutual information, namely 
the replica method, but found identical results with previous 
approaches |[T]. 

Based on the analysis carried out in this work, we may 
summarize some considerations on system design. In order 
to achieve a required target spectral efficiency at given block- 
error rate and SNR operating point, an attractive design option 



may consists of increasing the number of antennas (especially 
at the receiver) and using a low-complexity linear receiver 

Appendix 

We now sketch the basic steps in going from ( |23] ) to dZSt . 
We borrow heavily from the methodology discussed in Q. 
The basic idea behind the so-called replica trick is to evaluate 
( |23] | for integer /i and v and then analytically continue to 
continuous /i, v values. After introducing the /^i x /^i matrices 
Ti, Ri, the vxv matrices T2, R2 and the /.( x matrices T3, 
R3, following steps discussed in Q we can integrate over the 
channel matrix H and express ( |23] l as 



M = 5, N = 10, SNR = 3 dB 



M = 5, N = 10, SNR = 30 dB 



J D{Ti;ni;T2;n2;%;n3;)e-^ (35) 



= logdet(lM ® + Jfe f^Ti) 
+ logdet(lAr (8)1^. + R«l7^l) 

- Tr [TiUi + r27^2 + r37^^ + T^n^] 

+ logdet(lAr +R«)7^2 

- R(8)7^^ [Iat®!^ + R«)7^l]"^R(8)7^; 

1/2t1/2^ 



(36) 



logdet Im ® L + Ji ® T2 - 



[Im ® Ip 



-1 ^1/2^1/2 



where 




R 



1/2 



(37) 



We now need to specify the saddle point behavior of the 
integral over the T, TZ. Specifically, we set Tj, = TZ^ = 
and Ti = ^/MtkI^, TZi = y/Urkl^, T2 = VmUI^, 7^2 - 
^/Mrili,. The values of r^, tk are determined from saddle 
point equations (flSl l and (fl4l i and corresponding equations for 
ri and i;. To calculate the joint moment (IZSl l, we need to 
calculate the fluctuations due to T^, TZ^, since these are the 
fi X ly matrices that connect the mutual informations Ak, Ai. 
Indeed, expanding S to second order in these matrices and 
after we integrate over them we get precisely the term 



which, upon differentiation over v gives (IZST l. 



(38) 



References 

[1] K. R. Kumar, G. Caire and A. L. Moustakas, "Asymptotic Performance 
of Linear Receivers in MIMO Fading Channels," submitted for publica- 
tion to IEEE Trans. Inform. Theory, http://arxiv.org/abs/0810.0883 

[2] I. E. Telatar, "Capacity of multi-antenna Gaussian channels," Europ. 
Trans. Telecomm.. vol. 10, no. 6, pp. 585-595, Nov.-Dec. 1999. 

[3] G. J. Foschini and M. J. Gans, "On Limits of Wireless Communications 
in a Fading Environment when using Multiple Antennas," Wireless 
Personal Coimnim., vol. 6, pp. 311-335, 1998. 

[4] Draft Standardization Document: IEEE P802.11n/D2.00, February 2007. 

[5] Sergio Verdu, Multiuser detection, Cambridge Univ. Press, 1998. 



1 r 

0.8 
0.6 
0.4 
0.2 




2 4 6 8 

Ml (nats) 

M = 10, N = 20, SNR = 3dB 




M = 10, N = 20, SNR = 30 dB 



1 r 

0.8 
0.6 
0.4 
0.2 




1 

0.8 
0.6 
0.4 
0.2 




10 



15 20 60 65 70 75 80 

Ml (nats) 



Ml (nats) 



Fig. 3. CDF of the mutual information (MI) for the MMSE and optimal 
receivers, for M = 5, 10, (3 = 0.5 and p = 3, 30 dB. The solid blue line 
is the analytical result for the MMSE, the dot-dash blue is MMSE empirical, 
the dashed black is Optimal receiver analytical and the dotted black is the 
optimal receiver empirical. 



[6] K. R. Kumar, G. Caire and A. L. Moustakas, "The Diversity- 
Multiplexing Tradeoff of Linear MIMO Receivers," IEEE Information 
Theory Workshop, ITW 07. pp. 487^92, 2-6 Sept. 2007. 

[7] A. L. Moustakas, S. H. Simon, and A. M. Sengupta, "MIMO capacity 
through correlated channels in the presence of correlated interferers and 
noise: A (not so) large N analysis," IEEE Trans. Inform. Theory, vol. 49, 
no. 10, pp. 2545-2561, Oct. 2003. 

[8] W. Hachem, O. Khorunzhiy, P. Loubaton, J. Najim and L. Pastur, "A 
new approach for capacity analysis of large dimensional multi-antenna 
channels," Submitted to IEEE Trans. Inf. Theory, 2007. 

[9] D. N. Tse and O. Zeitouni, "Linear multiuser receivers in random 
environments," IEEE Trans. Inform. Theory, vol. 46, no. 1, p. 171, Jan. 
2000. 

[10] Y. C. Liang, G. Pan and Z. D. Bai, "Asymptotic Peiformance of MMSE 
Receivers for Large Systems Using Random Matrix Theory," IEEE 
Trans. Inform. Theory, vol. 53, no. 11, p. 4173, Nov. 2007. 

[11] M. Debbah et al, "MMSE analysis of certain large isometric random 
precoded systems," IEEE Trans. Inform. Theory, vol. 49, no. 5, p. 1293, 
May 2003. 

[12] D. Guo et al, "Mutual information and minimum mean-square eiTor 
in Gaussian channels," IEEE Trans. Inform. Theory, vol. 51, no. 4, p. 
1261, April 2005. 

[13] S. Verdu and S. Shamai, "Spectral efficiency of CDMA with random 
spreading," IEEE Trans, on Inform. Theory, Vol. 45, No. 2, pp. 622 - 
640, March 1999. 

[14] A. M. Tulino and S. Verdii, "Random matrix theory and wireless commu- 
nications," Foundations and Trends in Communications and Information 
Theory, vol. 1, no. 1, pp. 1-182, 2004. 



